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Speech sounds of the languages all over the world show remarkable patterns of co- 
occurrence. In this work, we attempt to automatically capture the patterns of co- 
occurrence of the consonants across languages and at the same time figure out the na- 
ture of the force leading to the emergence of such patterns. For this purpose we define 
a weighted network where the consonants are the nodes and an edge between two nodes 
(read consonants) signify their co-occurrence likelihood over the consonant inventories. 
Through this network we identify communities of consonants that essentially refiect their 
patterns of co-occurrence across languages. We test the goodness of the communities and 
observe that the constituent consonants frequently occur in such groups in real languages 
also. Interestingly, the consonants forming these communities reflect strong correlations 
in terms of their features, which indicate that the principle of feature economy acts as 
a driving force towards community formation. In order to measure the strength of this 
force we propose an information theoretic definition of feature economy and show that 
indeed the feature economy exhibited by the consonant communities are substantially 
better than those if the consonant inventories had evolved just by chance. 

Keywords: Consonants; complex network; community structure; feature economy; feature 
entropy. 

PACS Nos.: 89.75.-k, 89.75.Fb 



1. Introduction 

Sound inventories of the world's languages show remarkable regularities. Any ran- 
domly chosen set of consonants and vowels does not make up the sound inventory 
of a particular language. In fact one of the earliest observations about the con- 
sonant inventories has been that consonants ten d to occur in pairs that exhibit 
strong correlation in terms of their features^ In other words, consonants have 
a tendency to form groups or communities that effectively reflect their patterns of 

^In linguistics, features are the elements, which distinguish one phoneme from another. The fea- 
tures that distinguish the phonemes can be broadly categorized into three different classes namely 
the manner of articulation, the place of articulation and phonation. Manner of articulation spec- 
ifies how the flow of air takes place in the vocal tract during articulation of a phoneme whereas 
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Table 1. The table shows four plosives two 
of which are voiced, and, the other two are 
voiceless. It also indicates the two different 
places of articulation (dental and bilabial) for 
these plosives. If a language has in its con- 
sonant inventory any three of the four en- 
tries of this table, then there is a higher 
than average chance that it will also have 
the fourth entry of the table in its inventory. 



plosive 


voiced 


voiceless 


dental 


/d/ 


/t/ 


bilabial 


/b/ 


Ivl 



co-occurrence across the languages of the world. In order to explain these trends, 
feature eco nomy was proposed as the basic organizing principle of the consonant 
inventories! I '. According to this principle, languages tend to maximize the com- 
binatorial possibilities of a few distinctive features to generate a large number of 
consonants. Stated differently, a given consonant will have a higher than expected 
frequency in inventories in which all of its features have distinctively occurred in 
other sounds. The idea is illustrated, with an example, through Tabled Although 
there have been several attempts to explain the observed co-occurrence patterns'^ 
through linguistic insights SI as far as our knowledge goes there has been no work 
to identify the communities of consonants algorithmically. 

In this work, we propose a method to automatically capture the patterns of co- 
occurrence of the consonants across languages and at the same time quantify the 
driving force leading to the emergence of such patterns. For this purpose, we define 
the "Phoneme-Phoneme Network" or PhoNet, which is a weighted network where 
the consonants are the nodes and an edge between two nodes (read consonants) 
signify their co-occurrence likelihood over the consonant inventories. We conduct 
empirical studies of PhoNet and analyze it from the perspective of a social network 
where consonants exhibit community structures. Recently, several complex phe- 
nomena observed in the social, biological and physical worlds have been modeled as 
networks, whi ch pr ovides a comprehensive view of their underlying organizational 
principles. See^ l ^ lfor a review on modeling and analysis of such networked systems. 
There have been some attempts as well to model the intricacies of human languages 
through complex networks. Word networks based on synonymy '^'^ , co-occurrenceEl 
and phonemic edit-distance^^ are examples of such attempts. As a matter of fact, 
the distribution of the consonants across languages have also been modeled as a 
complex bipartite network in 1^1 but the study is limited to the occurrence of the 
consonants and not their co-occurrence. 

This article is organized as follows: Section |21 formally defines PhoNet and out- 



place of articulation specifies the active speech organ and also the place where it acts. Phona- 
tion describes the activity regarding the vibration of the vocal cords during the articulation of a 
phoneme. 
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line s its construction procedure. In section 13 we employ the extended Radicchi et 
al. algorithm, to find the communities in PhoNet. In section 0] we test the 
goodness of the communities and observe that the constituent consonants of these 
communities frequently occur in such groups in real languages also. Interestingly, 
the consonants forming these communities reflect strong correlations in terms of 
their features, which points to the fact that feature economy binds these commu- 
nities. In order to quantify feature economy we propose an information theoretic 
approach in sectional In the same section we show that the feature economy exhib- 
ited by the consonant communities obtained from PhoNet are indeed substantially 
better than those, if the consonant inventories had evolved just by chance. We also 
show that the number of languages in which the consonants of a community occur 
together increases with increasing feature economy. Finally we conclude in sectional 
by summarizing our contributions, pointing out some of the implications of the 
current work and indicating the possible future directions. 

2. PhoNet: The Phoneme-Phoneme Netv^rork 

We define PhoNet as a network of consonants, represented as G = ( Vc, E ) where 
Vc is the set of nodes labeled by the consonants and E is the set of edges occurring 
in PhoNet. There is an edge e £ E between two nodes, if and only if there exists 
one or more language(s) where the nodes (read consonants) co-occur. The weight 
of the edge e (also edge-weight) is the number of languages in which the consonants 
connected by e co-occur. The weight of a node u (also node-weight) is the number 
of languages in which the consonant represented by u occurs. In other words, if a 
consonant Ci represented by the node u occurs in the inventory of n languages then 
the node- weight of u is assigned the value n. Also if the consonant cj is represented 
by the node v and there are w languages in which consonants Ci and Cj occur 
together then the weight of the edge connecting u and v is assigned the value w. 
Figure d illustrates this structure by reproducing some of the nodes and edges of 
PhoNet. 

2.1. Construction of PhoNet 

Many typological studies ^^^^^^ of segmental inventories have been carried out in 
past on the UCLA Phonological Segment Inventory Database (UPSID) UPSID 
initially had 317 languages and was later extended to include 451 languages cov- 
ering all the major language families of the world. In this work we have used the 
older version of UPSID comprising of 317 languages and 541 consonants (henceforth 
UPSID317), for constructing PhoNet. Consequently, the set Vc comprises of 541 el- 
ements (nodes) and the set E comprises of 34012 elements (edges). At this point it 
is important to mention that in order to avoid any confusion in the construction of 
PhoNet, we have appropriately filtered out the anomalous and the ambiguous seg- 
ments'^ from it. In UPSID, a segment has been classified as anomalous if any of the 
following conditions holds: the segment is (1) rare (very low frequency), (2) occurs 
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Fig. 1. A partial illustration of the nodes and edges in PhoNet. The labels of the nodes denote the 
consonants represented in IPA (International Phonetic Alphabet). The numerical values against the 
edges and nodes represent their corresponding weights. For example /k/ occurs in 283 languages; 
jk™ I occurs in 39 languages while they co-occur in 38 languages. 



only in loans, (3) is existent only in underlying forms, (4) is derivable from other 
segments, or (5) obscure in description. We have completely ignored the anoma- 
lous segments from the data set. Ambiguous segments are those for which UPSID 
provides insufficient information. For example, the presence of both the palatal- 
ized dental plosive and the palatalized alveolar plosive are represented in UPSID as 
palatalized dental-alveolar plosive. In absence of any descriptive sources explaining 
how such ambiguities might be resolved, we have decided to include them as distinct 
segments. A similar treatment of anomalous and ambiguous segments has also been 
described in Pericliev and Valdes-Perez '^^ . Figure [5] presents a partial illustration 
of PhoNet as constructed from UPSID317. 



3. Identification of Community Structures 

There is a large volume of literature suggested by computer scientists, physi- 
cists as wsll as socio logists that speaks about identifying communities in a net- 
^0]-kyill 2 | l^^ | 19|21 | 22| ^]^jg jg niainly because, the ability to find communities within 
large networks in some automated fashion could be of considerable use. Communi- 
ties in a web S^P^ fo'^ instance might correspond to sets of web sites dealing with 
related topics'^, while commu niti es in a biochemical network might correspond to 
functional units of some kind 

In this work we attempt to identify the communities appearing in PhoNet by 
extending the Radicchi et al. algorithm for weighted networks'^. The algorithm of 
Radicchi et al. (applied on unweighted networks) counts, for each edge, the number 

''We have tried a few other community finding algorithms but this algorithm performs slightly 
better. Moreover, we found it easier to extend this algorithm to weighted networks. 
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Fig. 2. A partial illustration of PhoNet. All edges in this figure liave an edge-weight greater than 
or equal to 50. The number on each node corresponds to a particular consonant. For instance, 
node number 508 corresponds to /g/ whereas node number 540 represents /k/. 

of loops of length three it is a part of and declares that edges with very low counts 
as inter-conimunity edges. 

Basis: Edges that run between communities are unlikely to belong to many short 
loops, because to complete a loop containing such an edge there needs to be another 
edge that runs between the same two communities, and such other edges are rare. 

Modification for Weighted Network: Nevertheless, for weighted networks, 
rather than considering simply the triangles (loops of length three) we need to 
consider the weights on the edges forming these triangles. The basic idea is that 
if the weights on the edges forming a triangle are comparable then the group of 
consonants represented by this triangle highly occur together rendering a pattern 
of co-occurrence while if these weights are not comparable then there is no such 
pattern. In order to capture this property we define a strength metric S for each of 
the edges of PhoNet as follows. Let the weight of the edge {u,v), where u, w G Vc, 
be denoted by Wuv We define S as. 
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if y'}2,ieVc-{u v} ^'^ni — Wvi)^ > else 5 = oo. The denominator in this expression 
essentially tries to capture whether or not the weights on the edges forming triangles 
are comparable. If the weights are not comparable then this denominator will be 
high, thus reducing the overall value of S . PhoNet may be then partitioned into 
clusters or communities by removing edges that have S close to zero. 

In this algorithm we have neglected the edges in PhoNet that are connected to 
nodes having very low or very high node-weights since they are either insignificant'^ 
or assortative*^ (see for a reference) respectively. Henceforth we will refer to this 
version of PhoNet as PhoNetred- The entire idea is summarized in Algorithm^] Fig- 
ure |31 illustrates the clustering process. We can obtain different sets of communities 
by varying the threshold rj. As the value of i] decreases, new no des k eep joining the 
communities and the process is similar to hierarchical clustering ESI. Figure 0] shows 
a dendrogram, which illustrates the formation of the community of the consonants 
/{/, /ix/, /[/ and /i/ with the change in the value of rj. 



Consonant Communities 




Fig. 3. The process of community formation 



"^We have neglected nodes with node- weight less than 5 since these nodes correspond to consonants 
that occur in less than 5 languages in UPSID317 and the communities they form are therefore 
statistically insignificant. 

"^We have neglected nodes with node-weight greater than 130. These nodes correspond to conso- 
nants that occur in more than 130 languages in UPSID317 and therefore they co-occur with almost 
every other consonant. Hence the strength metric S is likely to be high for an edge connecting 
nodes (read consonants) with high node-weights. This edge (owing to its high strength) might 
then force two otherwise disjoint communities to form a single community. For instance, we have 
observed that since the consonants /m/ and /k/ are very frequent, the nodes corresponding to 
both of them have a high node- weight and consequently the edge between them also has a high 
edge-weight. The strong link between /m/ and /k/ then forces the respective bilabial and velar 
communities to merge into a single community. 
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Input: PhoNetred 


repeat 




for each edge (u,v) do 






Compute 












if \jY.ieVc-{u,v] i^ni - Wyif > else S = oo; 




end 




Redefine the edge-weight for each edge {u,v) by S; 




Remove edges with edge-weights less than or equal to a threshold 77; 




Call this new version of PhoNet, PhoNet^; 




Find the connected components in PhoNet,,; 






= J where 5 is the diminishing factor; 


until Phonetri gets fully connected ; 



Algorithm 1: Algorithm for finding communities based on edge strength 



Table 2. Consonant communities 



Community 


Features in Common 


A/, /d/, /n/ 


dental 


/t/, /n./, /I./, Ul 


retroflex 


/w/, /i/, /m/ 


laryngealized 



i| - «.35 



1| = 0.72 



i| = 1.25 




Fig. 4. The dendrogram illustrates how the retroflex community of 74/5 /t/i ^ l\l ^-^id /^/ is 
formed with the change in the value of r) 



Some of the example communities obtained from our algorithm are noted in 
Table|21 In this table, the consonants in the first community are dentals, those in the 
second community are retroflexes, while the ones in the third are all laryngealized. 
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4. Evaluation of the Communities based on their Occurrence in 
Languages 

In the earlier section we have mainly described the methods of extracting the conso- 
nant communities from PhoNet. In this section we look into the languages included 
in UPSID317 and inspect whether or not the consonants forming the communities 
in PhoNet actually occur in such groups. 

For this purpose we first arrange the consonants forming a community C, of size 
N, in an ascending order of their frequency of occurrence in UPSID317. We associate 
a rank R with each of the consonants in C where the least frequency consonant gets 
a rank R ~ I, the second least gets a rank R = 2 and so on. Starting from rank R 
= 1 we count how many of the consonants in C, occur in a language L G UPSID317. 
Let the number of such consonants be M . We define the occurrence ratio Ol of the 
community C for the language L to be 

M 

^ N - 1) 

where Rtop is the rank of the highest ranking consonant that is found in L. The 
denominator of this ratio is N— {Rtop — I) instead of N since it is not mandatory for a 
language to have a low frequency member of a community if it has the high frequency 
member; nevertheless if the language already has the low frequency member of the 
community then it is highly expected to also have the high frequency member" El 
The average occurrence ratio Oav for the community C can be obtained as follows, 

Oa. = ^^"7"^^-- (3) 
^ occur 

where Loccur is the number of languages in UPSID317 that have at least one or 
more consonants occurring in C. Figure [S] shows the average Oav of the communi- 
ties obtained at a particular threshold 77 versus the threshold ry. The curve clearly 
shows that the average Oav of the communities obtained from our algorithm for 
r] > 0.3 is always more than 0.8. This in turn implies that on an average the 
communities, obtained at thresholds above 0.3, occur in more than 80%f of the lan- 
guages in UPSID317. At thresholds below 0.3 the average Oav falls gradually since 
giant components start forming and the probability of all the consonants in the 
giant component occurring together in languages is very low. Hence the community 
structures obtained from our algorithm are true representatives of the patterns of 
co-occurrence of the consonants across languages. 



''For instance let the community C be formed of the consonants jk™ j , jk^ j and jkj as shown in 
Figure^ When we inspect the language L it is not necessary for it to have /k^ / or /k^ / if it has 
/k/ in its inventory; nevertheless it is highly expected that if it already has /fc™/, it should also 
have /k/ and /k^ / in its inventory. 

^The expectation that a randomly chosen set of consonants representing a community of size 
between 2 to 5, occurs in a language, is 70% whereas the same is 89% for the communities observed 
in PhoNet. 
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Fig. 5. Average Oav of the communities obtained at a particular threshold rj versus the threshold 



5. Feature Economy: The Binding Force of the Communities 

In the earlier sections we have mainly focused ourselves to the detection and eval- 
uation of the communities emerging from PhoNet. In this section we attempt to 
explore whether or not the driving force, which leads to the emergence of these 
communities, is feature economy. For this reason we introduce a quantitative mea- 
sure of feature eco nom y. The basic idea is borrowed from the concept of entropy in 
information theory El. 

For a community C of size N let there he pf consonants, which have a particular 
feature / (where / is assumed to be boolean in nature) in common and qf other 
consonants, which lack the feature /. Thus the probability that a particular conso- 
nant chosen uniformly at random from C has the feature / is ^ and the probability 
that the consonant lacks the feature / is ^ (=1-^). If F be the set of all features 
present in the consonants in C then feature entropy Fe can be defined as 

feF 

The process of computing the values of Fe for two different communities of conso- 
nants is illustrated in Figure El 

Fe is essentially the measure of the minimum number of bits that are required 
to communicate the information about the entire community C through a channel. 
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C, = {/W. M, /g/} Cj = {/b/, /n/, /£?/} 

N, = 3 = 3 

F, = {voiced, dental, bilabial, velar, plosive} = {voiced, dental, bilabial, nasal, retroflex. plosive} 



F, 


voiced 


dental 


bilabial 


velar 


plosive 




r^ 


voiced 


dental 


bilabial 


nasal 


retroflex 


plosive 


ibl 


1 





1 





1 


Ibl 


1 





1 








1 


Idl 


1 


1 








1 


W 


1 


1 





1 








isi 


1 








1 


1 




im 


1 


1 








1 





P,'N, 


1 


0.33 


0.33 


0.33 


1 




1 


0.67 


0.33 


0.33 


0.33 


0.33 


q,'N, 





0.67 


0.67 


0.67 










0.33 


0.67 


0.67 


0.67 


0.67 



Ff=2.75 Fp = 458 



Fig. 6. The process of computing the value of Fe for the two different communities Ci and C2 

Thus, the lower the value of Fe, the better it is in terms of information transmission 
overhead. To have more information conveyed using a fewer number of bits, max- 
imization of the combinatorial possibilities of the features used by the constituent 
consonants in the community C is needed. This is precisely the prediction made 
by the principle of feature economy^. In fact, it is due to this reason that in Fig- 
ure Fe exhibited by the community Ci is better than that of the community C2, 
since in Ci the combinatorial possibilities of the features is better utilized by the 
consonants than in C2. 

Figure |7| illustrates, for all the communities obtained from the clustering of 
PhoNet, the average feature entropy exhibited by the communities of a particular 
size'' (y-axis), versus the community size in log scale (x-axis). 

We next investigate whether or not the communities obtained from PhoNet are 
better in terms of feature entropy than they would have been, if the consonant 
inventories had evolved just by chance. For this purpose we construct a random 
version of PhoNet and call it PhoNetrand- 

Construction of PhoNet^and: For each consonant c let the frequency of occur- 
rence in UPSID317 be denoted by fc- Let there be 317 bins each corresponding to a 
language in UPSID317. fc bins are then chosen uniformly at random and the conso- 
nant c is packed into these bins. Thus the consonant inventories of the 317 languages 
corresponding to the bins are generated. PhoNetrand can be then constructed from 

SThe lower the feature entropy the higher is the feature economy. 

''Let there be n communities of a particular size k picked up at various thresholds. The average 
feature entropy of the communities of size k is therefore ^52"=i where Fe^ signifies the feature 
entropy of the community. 
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1 1 ^ . ^ ,_ 

1 10 

Community Size 



Fig. 7. Curves showing average feature entropy of the communities of a particular size versus the 
community size (in log scale) for PhoNet and PhoNetj-and- 

these new consonant inventories similarly as PhoNet. The method is summarized 
in Algorithmic 



for each consonant c do 




for i = 1 to fc do 






Choose one of the 317 bins, corresponding to the languages in 






UPSID317, uniformly at random; 






Pack the consonant c into the bin so chosen if it has not been already 






packed into this bin earlier; 




end 


end 




Construct PhoNetmnd, similarly as PhoNet, from the new consonant 


inventories (each bin corresponds to a new inventory); 



Algorithm 2: Algorithm to construct PhoNetrand 



We apply Algorithm^in order to find the communities appearing in PhoNetrand- 
The average feature entropy for the communities of a particular size (y-axis), versus 
the community size in log scale (x-axis) are shown in Figured (along with the curve 
for PhoNet). A closer inspection of the curves immediately makes it clear that the 
average feature entropy exhibited by the communities of PhoNet are substantially 
better than that of PhoNetrand especially when the community size remains less 
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than 15. As this size increases, the difference in the average feature entropy of the 
communities of PhoNet and PhoNetrand graduaUy diminishes. This is because, the 
community then comprises of almost all the nodes of PhoNet which are also the 
nodes of PhoNet^and- Hence the average feature entropy exhibited by the respective 
giant components of PhoNet and PhoNetrand is close and this closeness increases 
with the increase in the size of the giant component. 

Figure |H1 (showing the average feature entropy of the communities for different 
values of rj in the y-axis versus the threshold i] in the x-axis) further strengthens 
the fact that feature entropy exhibited by the communities occurring in PhoNet 
are substantially better than those occurring in PhoNetrand- It clearly shows that 
the average feature entropy of the communities, obtained at all thresholds greater 
than 0.2, are significantly lower in case of PhoNet than in PhoNetrand- Below this 
threshold, gradually the average feature entropy of the communities of PhoNet and 
PhoNetrand comc closer, until they are identical. Another important observation 
is that the communities of PhoNetrand do not emerge at thresholds greater than 
0.8. This points to the fact that strong patterns of co-occurrence would not have 
surfaced if the consonant inventories had just evolved by chance. 

The above results not only validate our definition of feature entropy but is also 
indicative of the fact that the community structures observed in PhoNet are not 
arbitrary and are true representatives of feature economy claimed to be observed 
across languages. In fact, the argument can be further validated by looking into 
the languages recorded in UPSID317 and examining whether or not the consonants 
forming the communities in PhoNet occur in these languages so as to minimize 
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Feature Entropy 

Fig. 9. Average occurrence ratio (Oau) versus the feature entropy of the communities. Each point 
corresponds to a single community 

feature entropy. 

Figure El shows the scatter plot of the average occurrence ratio of the communi- 
ties obtained from PhoNet (y-axis) versus the feature entropy of these communities 
(x-axis). Each point in this plot corresponds to a single community. The plot clearly 
indicates that the communities exhibiting lower feature entropy have a higher av- 
erage occurrence ratio. For communities having feature entropy less than or equal 
to 3 the average occurrence ratio is never less than 0.7 which means that the con- 
sonants forming these communities occur together on an average in 70% or more 
of the world's languages. As feature entropy increases this ratio gradually decreases 
until it is almost close to when feature entropy is around 10. This again attests 
the fact that the driving force behind the formation of these communities is the 
principle of feature economy and languages indeed tend to choose consonants in 
order to maximize the use of the distinctive features, which are already available in 
their inventory. 



6. Conclusions and Discussions 

In this paper we have explored the co-occurrence principles of the consonants, across 
the inventories of the world's languages. Firstly, we have presented an automatic 
procedure to capture the co-occurrence patterns of the consonants across languages. 
It is important to mention here that this automation also provides an algorithmic 
definition of natural classes ^ of phonemes (Tabled is a natural class of plosives). 
This is significant because there is no single satisfactory definition of such natural 
classes in literature ^. The communities that we obtained from PhoNet are such 
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natural classes and we can derive them just by regulating the threshold of our 
algorithm. 

Secondly, in order to quantify feature economy we have introduced the notion 
of feature entropy. This quantification immediately allows us to validate the expla- 
nation of the organizational principles of the sound inventories in terms of feature 
economy, provided by the earlier researchers. 

Some of our important findings from this work are, 

• The patterns of co-occurrence of the consonants, reflected through commu- 
nities in PhoNet, are observed in 80% or more of the world's languages; 

• Such patterns of co-occurrence would not have emerged if the consonant 
inventories had evolved just by chance; 

• The consonant communities that maximize feature economy tend to occur 
more frequently (70% or higher number of times) in the languages of the 
world. 

Until now we have emphasized on the fact that feature economy is the driving 
force behind the formation of consonant communities. An issue which draws atten- 
tion is that how such a force might have originated. One possible rea son could be 
due to c ertain general principles like maximal perceptual contras^^ and articula- 
tory ease 121^ and ease of learnability^. For instance, maximal perceptual contrast, 
which is desirable between the phonemes of a language for proper perception of each 
individual phoneme in a noisy environment, would try to reduce feature economy 
(since better perception calls for use of a larger number of distinctive features). On 
the other hand, ease of learnability, which is required so that a speaker can learn a 
language with minimum effort, tries to increase feature economy (since learnability 
increases if there are only a few distinctive features to be learnt). It would be inter- 
esting to see how the quantification of feature economy can help us in understanding 
the interplay, between these principles, that goes on in shaping the structure of the 
consonant inventories. We look forward to do the same as a part of our future work. 
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